Camera based video games and related methods for exercise motivation

ABSTRACT

Disclosed are methods and apparatus for motivating persons to undertake exercise, employing camera based computer monitoring of persons and/or exercise apparatus, and displays of video data, which may be derived from such monitored information.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 11/118,774filed on May 2, 2005, now U.S. Pat. No. 7,328,119 which is acontinuation in part of application Ser. No. 09/799,797 filed on Mar. 7,2001; now abandoned and which claims benefit of U.S. ProvisionalApplications, 60/187,396 filed on Mar. 7, 2000, by Tim Pryor, and60/187,397 filed on Mar. 7, 2000, by Tim Pryor and Marie Pryor. Thesubject matters of which are all incorporated herein in their entiretyby reference.

RELATIONSHIP TO OTHER APPLICATIONS

Touch TV and other Man Machine Interfaces (Ser. No. 09/435,854 which wasa continuation of application Ser. No. 07/946,908, now U.S. Pat. No.5,982,352);

Useful Man Machine interfaces and applications Ser. No. 09/138,339;

Ser. No. 09/789,538 entitled Programmable Tactile touch Screen Displaysand Man machine Interfaces for Improved Vehicle Instrumentation andTelematics;

U.S. Ser. No. 10/611,814 filed Jul. 2, 2003; U.S. Ser. No. 09/789,538entitled Programmable Tactile Touch Screen Displays and Man-MachineInterfaces for Improved Vehicle Instrumentation and Telematics;

PCT/US2004/09701 filed Mar. 31, 2004, entitled Reconfigurable VehicleInstrument Panels;

U.S. Ser. No. 09/568,552 Picture Taking method and apparatus;

U.S. Ser. No. 09/612,225 entitled Camera Based Man Machine Interfaces;

U.S. Ser. No. 10/934,762 entitled Reconfigurable Control Displays forGames, Toys, and other applications filed Sep. 7, 2004;

Ser. No. 11/045,131 filed Jan. 31, 2005, entitled Reconfigurable TactileControl Displays For Automobile Instrument Panels and otherApplications; and

U.S. Ser. No. 09/612,225 entitled Camera Based Man Machine Interfaces.

Copies of the disclosures of the above U.S. patents and co-pendingpatent applications are also incorporated herein by reference in theirentirety. Additionally incorporated by reference are other patents andapplications of Tim Pryor and his colleagues: U.S. Pat. Nos. 5,880,459,5,877,491, 5,734,172 and 5,670,787

Also of reference are two articles, provided previously with theprovisional applications: Consumer Reports, January 2000 issue, Page 15,and “3D human fashion model generation” by Textile Technology Co. (fromthe TC2 website).

FEDERALLY SPONSORED R AND D STATEMENT

not applicable

MICROFICHE APPENDIX

not applicable

FIELD OF THE INVENTION

The disclosed invention relates to methods for assisting and motivatingpersons with respect to various dietary and exercise regimens they mightundertake, providing an interactive, iterative, “what-if” type ofprocedure where someone can see their predicted appearance in thefuture, also in clothes of their choice, and balance this with realisticexpectations of what they may be able to achieve in terms ofmodification of their physical shape as a result of a planned course ofaction. The invention in a related manner also contains novel methodsfor helping persons with mental illnesses and other persons improvetheir quality of life and diagnose difficulties. In addition, theinvention optionally links ones planned future appearance with theselection of clothing available for purchase today or in the future.This leads to new methods of clothing manufacture suited to such astrategy, and new and useful methods of purchasing dietary and medicalitems and apparel in the present and future, particularly from storeswhose provided data bases accommodate the invention.

The invention also concerns an optional and unique life size displayscreen, a “digital mirror” so to speak, for input to, and display of,the computer aided models used, as well as inputs from a persons bodysensed by TV cameras.

BACKGROUND OF THE INVENTION

The invention is concerned with predicting and displaying onesappearance in the future as a result of dietary and exercise programs,as a way to both chose a particular program and provide motivation forexecuting the program. It further comprehends motivation by showing whatone would look like in particular clothes one might choose. There is noknown reference predating our invention disclosing such methods orapparatus.

The invention in a related manner, also applies to the selection,purchase, and manufacture of clothes. Today, people buy “ready to wear”clothes by going into a store trying on a few examples, and hopefully,buying one—assuming their size is in stock, or the designs in stock arepleasing to them at a price they can afford. Of late, there has beenidentified a possibility of mass scale customization of clothes, usingtwo (at least) technological breakthroughs—the fast programmable cuttingof material in lot of one, and the ability of 3D measurement devices toscan a persons body at a large number of data points in order to give acustom data input to the computerized clothes design—in theory resultingin a perfect fit every time, and vastly reducing logistical complexityand cost related to stocking of multiple sizes and styles. (ConsumerReports, January 2000 issue, page 15, referenced above. See also as oneexample, the Proceedings of the 80th World Conference of the TextileInstitute, April 2000 Manchester, U.K.). There is also a considerablebody of patent art on various aspects of computerized clothing design,manufacture, and marketing, see for example U.S. Pat. Nos. 4,261,012Maloomian; 4,546,434 Gioello; 4,916,634 Collins et al.; 5,163,006Deziel; 5,163,007 Slilaty; 5,495,568 Beavin; 5,551,021 Harada et al.;5,680,314 Patterson et al.

The basis of most 3D measurement devices is optical triangulation, forexample as described in U.S. Pat. No. 5,362,970 or 5,670,787. Versionsusing scanning laser beams, and projected grids are most prevalent forthe human body digitizing application which requires significant speedif done in real time, due to the problem of human movement.

U.S. Pat. No. 4,261,012 Maloomian, “System and method for compositedisplay” seems to have been the first to associate an image of acustomers head, with a stored figure image of a model. Subsequentinventors, such as Andrea Rose in U.S. Pat. No. 5,930,769, have refinedthe model, and worked out methods for interfacing with the manufacturingsystems, and the way of doing business that surrounds the ability toprovide clothing fit related fashion data to a consumer.

Recently some companies, such as Lands End, have introduced simplifieddata input means such that over the internet, one can look at a 2D imageof what clothes you chose could look like on you. Lands End's effort isbased apparently based at least in part on U.S. Pat. No. 5,930,769, theclosest known reference to the fashion related aspects of the inventionherein. In the Rose patent, the customer initially inputs informationincluding body measurements and a digital photograph of the customer'sface. Typical body measurements for women include; center front, armlength, bust, waist, hip, and height. Center front 2 is measured fromthe hollow of the neck of the customer to the navel. Body type/statureis also a desirable input to the Rose system.

SUMMARY OF THE INVENTION

Our invention discloses method and apparatus by which persons mayvisualize their appearance in the future based on actions they may takefor themselves, in particular in undertaking a weight loss or exerciseprogram also as a potential purchaser of clothing, the fit of whichmight also be predicated on successful execution of the program inquestion. The invention uniquely allows a “what if” scenario related toa display to the user of their future appearance, under the influence ofvariables affecting same, primarily diet, and exercise. This in turnallows one to evaluate the various tradeoffs and to optimally select aprogram, modifying it along the way and modifying expectations asneeded.

Method and apparatus are disclosed for improving the likelihood ofsuccess of a given health plan by prediction of future appearance andproviding an ability to monitor the movement and shape of the user inorder to tailor the plan, and the video or other instructions andstimuli given the user to suit the situation. Direct feedback to theprogram and back to the user from remotely located internet sources orlocal DVD or other data storage is enabled as desired by the novelinputs, many of which have been disclosed in co-pending referencedapplications.

The foregoing capability of the invention is believed to provide a highdegree of motivation for maintaining a regimen for weight loss (or lesscommonly, weight gain), or other physical modification activities. It isthus important as at least a partial answer to the “obesity crisis”.This application also explores some other aspects of this relating toimproved prediction of physical shape in the future by tracking progressvia measurements taken as a function of various diet and exercise, andthe continual feedback of this updated model to both the customer, thetrainer or dietician, and to the manufacturer where apropos. In additionthe invention provides incentives to stick to a diet and exercise, bygiving not only fashion or other appearance related inspiration, but bytailoring workout videos and the like to suit the persons needs, suchthat the workout may be paced to the actual action and needs of theperson and in conjunction with a chosen dietary and exercise or otherhealth plan.

Hardware and software systems incorporating automatic and semiautomaticmeasurement are disclosed useful for stores and “Weight Watcher” typemeeting rooms, as well as the home. Further Improvements inmerchandising and manufacture of garments are also disclosed whichrelate to the ability to predict future needs and shapes of customers.

In the sense of clothing selection, neither Rose, nor any otherreference has addressed the “what if” future scenario possibility—thatis, “what will I look like in a particular outfit, if I take someaction”? And what are the tradeoffs between selection of apparel and theachieving a new figure, in a given time period?

Nor has anyone addressed the issue of “what will I look like in aparticular existing outfit or design, if I, or the manufacturer, or anintermediate party, do something to it”? And what are the tradeoffsbetween selection of apparel and alteration, in a given time period andat a given cost? In addition, none heretofore appear to have addressedthe hardware and related aspects that would make the shopping experienceusing the technology available, really useful and effective—especiallyin a home environment.

The invention also allows one to model a business as to how this affectsclothes choice and ramifications thereof, including into the future. Itprovides a method to visualize oneself full size—with respect to attire,hair, accessories, and many other things making up ones impression onthe world, also including the effects of diet, exercise etc on onesfuture appearance. Indeed using the invention, and with the advent ofaffordable large screen displays, the digital model created can bedisplayed “life size” even in a persons home, just like looking in amirror in a clothing store (or at home), but instead seeing a “DigitalYou”, in a particular outfit, and with the benefit of an exercise orweight loss or gain program, or other means to modify your appearance ifdesired (including in the final analysis, the choice or dimension ofprospective clothing itself). Because it is a simulation, one can “tryout” not only different clothes in a lifelike way, but also see theeffects on your appearance in one article or another, in one size oranother or of different weight loss regimens over different time periodsfor example.

Given all of the advantages, it is thus a goal of the invention toprovide method and apparatus to allow one to visualize, create, andmodify a model of oneself or others in clothes of interest, and to do soin a manner convenient for a large number of users.

It is a goal of the invention one to predict and display the effect onones appearance (clothed, or even unclothed) of future activity chosen,such as diet or exercise, also as a function of the apparel chosen. Andit is a goal to allow one to iterate the prediction, such that a one canoptimally tradeoff the various factors such as caloric intake, exercisetime and the like, with ones appearance predicted to result from doingsame.

It is a further goal to provide one an incentive to first choose, andthen to stick to a diet and exercise plan, (including modifying it asneed be), by giving not only fashion or other appearance relatedinspiration, but by tailoring workout videos and the like to suit thepersons needs, such that the workout may be paced to the actual actionand needs of the person if desired.

It is an added goal of the invention to improve health andself-confidence by motivating persons to stick to a dietary and/orexercise plan and to optionally provide a means for dynamic modelanimation by which one can visualize the way in which ones body changeswith regimen selected

It is a goal of the invention to provide interactive choice of dietaryand/or exercise plan regimen to maximize an attainable result desired,and to provide predictions of ones measurements or shape at a certainpoint in time, if a plan is undertaken, which plan can be constantly updated to either arrive at the same shape, or a new shape.

It is a further goal of the invention to provide a simple means forentering 3D data points from a persons body into a computer program tographically model their body or a future manifestation thereof in 3dimensions.

It is a goal of the invention is to provide data dynamically duringexercise, to see the effects on ones appearance of continuing a givenregimen, or changing plans. It is an additional goal of the invention toprovide methods to assist in the treatment of mental, behavioral, orother disorders, and in situations where a form of companionship may beprovided the user.

It is a further goal of the invention to provide an improved method forselection and purchase of clothes, including the purchase of clothes inthe future. And it is a still further goal of the invention to providean improved method for the manufacture and distribution of clothes,lowering the price thereof, also by providing a method for prediction offuture clothing needs and production planning related thereto and modela business as to how this affects the clothes choice and ramificationsthereof in the future, and to produce or inventory garments in new waysnot heretofore economic.

These and other goals of the invention are illustrated in the followingfigures:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a Block Diagram of how the basic invention is utilized toprovide input data to ones digital model, and to utilize data therefrom, also as to ones future appearance and in consideration of a numberof interactive clothes choices and diet/exercise regimens.

FIGS. 2 a-2 e illustrate several methods and apparatus how the inventionmay be utilized to provide input data, to react with a number ofinteractive clothes choices and diet/exercise regimens, which addressesweight, figure, or clothes choice related dimensional input issues tothe digital figure model. Illustrated are systems ideal for use In homeor Boutique, which can include modifying dimensions looking at digitalmodel and moving your hands, touching a screen or the like.

FIG. 3 further illustrates data input and display using the invention,particularly with a touch screen, also illustrating logistical andcommercial aspects of the invention, display in ones home or elsewhereis preferably life size screen, and the digital image produced may becreated or modified using an ability to touch (or otherwise indicate on)ones self or ones digital self (and future self) represented on thescreen. An interactive session of a user employing the inventions methodof inputting and providing dynamically variable choices of alterationsor styles, or even entire lines of garments is disclosed.

FIG. 4 is an interactive session of a user employing the invention, alsoillustrating clothing related logistical and commercial aspects of theinvention

FIG. 5 illustrates methods which address weight related dimensionalinput issues to the digital figure model and how the invention may beutilized to provide data as to ones future appearance.

FIG. 6 is a diagram of a possible “Weight watchers” (or otherorganization) meeting area, using a relatively inexpensive automatic orsemi-automatic scanner to obtain clients measurements. A full length“digital mirror” of the invention may be optionally provided, and datataken may be transferred to home computers and displays of clients ifdesired.

FIGS. 7 a and 7 b illustrate real time user assisted creation of 3D bodymodels from 2D camera images.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1

A discussion of 3D digital models of humans and dense scan data methodsof creating them is given by Textile Technology on their web site,referenced above. These models can be created and changed by theirmethod, by means herein disclosed (as well as in co-pending references),or other methods. A real benefit of the means herein disclosed is thatthe equipment is simple, and can be used in the privacy of ones home. Itis ideal for updating of complex models once created. This isparticularly of use, as by definition ones figure changes with diet andexercise, and the “present” model then can be, and should be, changed tosuit. Its noted that one can store models, so that the “before”“present” and “future goal” models can all be compared. This is asophisticated way of picturing results, far beyond the common practicetoday of comparing scale readings.

There are several models of interest in this application. One is thebasic human Body Model, such as shown in referenced articles however,initially created. A second model is what is here called the DressedModel, that is the basic model with the clothes fitted to it, using abest fit routine or some other fitting procedure applicable to the typeof clothes in question. For example, if pants are to be fitted, a firststep could be to fit the pants model to the basic human body model atthe waist, and provide this view to the customer. The view could also beprovided with the pants slipped down an inch as well, as often happenswhen pockets are full, or while walking etc. This is one of the benefitsof simulations of this type—a whole range of characteristic situationscan be tried very quickly to see their effect, in this case perhapsconvincing the customer or seller or modifier to make the pants cuffs abit shorter.

A further model, discussed in FIG. 5, comprehends a future Body Model,with its attendant Dressed models as disclosed herein.

For this application, the display used for the digital modelpresentation is preferably located in ones home and is preferably a lifesize display, today created by a projection type system, typically rearprojection. The digital image produced is not only created but thenmodified using an ability to touch ones self or ones digital self (andpotentially projected future self) represented on the screen. With theadvent of affordable large screen displays, especially those on thehorizon for HDTV using low cost micro display based projector systems,the digital model created can thus be displayed “life size” even in apersons home, just like looking in a mirror in a clothing store, butinstead seeing a “digital You”, in a particular outfit, and with thebenefit of an exercise or weight loss or gain program, or other means tomodify your appearance. Because it is all a simulation, one can “tryout” not only different clothes in a lifelike way, but also see theeffects on your appearance in one article or another, in one size oranother, and in one state of alteration or another, for example.

FIG. 1 is a Block Diagram of how the basic invention is utilized toprovide data as to ones appearance in clothes of a given type. This canbe used solely for the purpose of prediction of ones appearance, in agiven set of clothes already on hand, or in an interactive “what if”tradeoff analysis, with a selection of clothes to be considered forpurchase, with various types and costs of alteration strategies, orpartial custom assembly strategies, including select fitting ofcomponents and/or custom tailoring of one or more components, and/oralteration of one or more already made components.

In general for this purpose, the body may be measured, not just for itsdimensions that relate to fit of clothes per se (for example the basicones in the Rose patent), but also with respect to certain dimensionsand other medical factors if desired that define ones shape. Height,weight, age, general stature, and other factors—including any specialcase issues, may also be inputted as well.

The invention contemplates that the actual procedure can vary. A typicalembodiment would do the following. First in step 10, the user enterstheir dimensions and other information as called for by the program,which may include, for example dimensions of key parameters of thepersons body necessary for establishment of a minimum 3D Body Model. Forexample, some are mentioned above per the Rose patent, including waistsize, arm length, neck size, shoulder dimensions, etc. Generally onewould also enter ones current size as you understand it for what everthe garment item is, giving the program a place to start and the abilityto cross check for the rationality of the dimensional body data inputted(with suitable questions presented to the user if the two did notreasonably match). It is contemplated that increasing levels of modelsophistication will require many more dimensions as input.

In addition the user may add in step 11, any commercially relevant data,for example desired delivery and cost data, and whether or not onewishes to consider alteration strategies and the like. Optionally, instep 12, Physical body health related dimensions and other applicableparameters such as % fat mass, stature, etc. These are needed ifprediction of the future model shape is desired (discussed further inFIG. 5), and may include other physical health related data, includingMedical history as applicable.

This data is then provided to the program, which generally is locateddistant and accessed over the internet, but could alternatively be onDVD disc, CD Rom or other local storage medium, or downloaded theretooff the internet for example. A model 15 is then created of the persontoday. The model can be a 3D digital model created by known means, forexample using a 3D solid model package such as “CADKEY”. Such a model isshown in the referenced Textile Technology article.

It is contemplated that the entry of data can in some cases be automaticusing for example, features of the invention, or the inventionsdisclosed in the co-pending references.

The program in the second step then optionally can ask one or morequestions, for example questions related to the degree of fit desired,for example tight fit, loose fit, baggy, etc. it can even be specific asto where—in the buttocks, for example. It can also ask if one wants tofit a certain size, or and if one doesn't, what it would take to do sowith various suggestions made by the program to do so, such as methodsto lose weight for example (see also reference 8).

A Body model 15, of the person is created from the measurements, and avideo image of the users head 30, taken for example using camcorder orTV camera 31, superposed if desired, as in simply done in the U.S. Pat.No. 4,261,012 patent (Maloomian), or with more views taken as isdesirable and taught by Rose. The model at this point more or less lookslike the person.

The customer then tells the program what they are interested in 35, andpicks the specific clothing 45 they are interested in from the selection40 offered by the vendor program, or suggested by same given taste dataentered by the customer. This step can include several iterativeconsultation steps with the program or a real consultant on line. Theclothes selection step could involve an automated, or even human on linefashion consultant as contemplated by Rose.

The dressed model 50 of the person, is then created (typically on aremotely located program at the clothing vendor site) using a Clothingdata base 55 typically at the vendor site of the clothing itself and theresults (and perhaps the whole data file) presented, typically as adisplay on the dressed model, to the user in the clothing selected bythe user from styles and sizes presented to same by the program, giventhe users taste. Such data 55 would typically, but not necessarily beprovided by the clothes vendor, for example on their web site.Alternatively the clothes data base could be downloaded to the user, andthe fitting done to the model locally at the user site using storedprograms there. Areas which need attention fit-wise, if any, are thenhighlighted by the program, and or inputted by the user as disclosedherein.

The user in step 60 can now consider the results and decide what to do.Most typically, the user would iteratively repeat the steps describedabove, also with the input of different clothes styles and sizes,together with continual iteration of diet and exercise plan,(ifconsidered, as discussed below), until the desired practical appearanceand clothes purchase (possibly for future delivery) plan 70 is arrivedat. Since the invention contemplates method and apparatus to do all ofthis in private, there is no embarrassment, and a realizable plan can beachieved.

Such iterations could be lengthy, and the subject of debate with theusers peers, family members, health advisors, weight watcher groups, andthe like. And it could go on for several days or longer—impossible in astore or other public venue under most conditions. A final, “purchase”step is indicated at 75.

FIG. 2

For someone wishing to buy clothes over the internet or other homeshopping venues, we feel it is much more convenient to providemeasurements taken in your own home. This, in the Rose patent, requiresyou to manually take the measurements yourself and type them in, not toodifficult if only a few are required, but still prone for error and formany, unattractive. In general, it would be more desirable to have someor all of the measurements automated and to be able to take manymore—which then could lead up to the mass customization of clothing inlot of one discussed in many textile institute papers. And for thoseinterested in predicting their future appearance in clothes of whateverstyle and size is of interest to them, they must input their presentshape, their intentions, and possibly other medically related data. Thisis data that most people want to keep private. An overweight person forexample, may be uncomfortable going to some emporium where measurementsare taken.

In addition, many people are uncomfortable in shops, letting othersmeasure them and suggest sizes or alterations, particularly if theresult suggested exceeds a preconceived idea of the customer of whatthey should be (but not necessarily are). Many a sale has been lost thisway, or many a person has purchased a size too small, just because of alack of candor in this regard. The invention solves these problems,because tasks normally done in a store are enabled in the home (thoughthe invention can be used in stores as well).

FIG. 2 illustrates several embodiments which answer many of thedimensional input requirements. Many features are also discussed inco-pending applications incorporated by reference.

As pointed out, ones basic body dimensions can be inputted manually, asin the Rose invention, or inputted from a full 3D scan such as disclosedin the referenced articles (which today would need to be done in aspecial facility, but which could be done at low cost in the home usingthe invention, if suitable software and training were provided, forexample over the internet from a remote source).

Regardless of how data was initially inputted, it would still bedesirable to periodically, and if possible, automatically, update themodel of the person, especially during a period of weight change orexercise. And it is useful to provide data on existing clothes from oneshome, to interact with designers of future clothes or those providingalterations to existing clothes. This can be the case where you tell aremote source of clothes, that you want something just like a garmentyou have but with the following differences . . . (size, color, pleats,lengths, pattern, ad infinitum).

For automatic entry of dimensional points on the body or clothing,several types of sensors are possible. Illustrated particularly here isone class, that of electro-optical and particularly TV camera basedsensors. These sensors are inexpensive, accurate, have large range, andin many cases are able to acquire multiple data points on the person atonce. In addition they generally are digital and largely driftfree—important for calibration purposes, and measurements taken overtime as in during months of dieting for example. Four camera basedsensor versions are here shown, all which use Single or Plural TVcameras to obtain data at low cost in the home or wherever. For use witha plurality of cameras such as stereo camera pairs or triplets, theseare:

Use of a laser spot pointer;

Use of a touch finger, or finger pair (also thumb and finger);

Use of a laser line pointer; and

For use with the above stereo cameras, or even a single camera, amechanical probe with multiple target datum's.

In general, there are two modes for such application which are “Natural”in the sense of one being able to perform operations similar to thoselearned in everyday life. In the first case, you can stand back, andlook at a digital display of yourself in a “mirror” (in effect a digitaldisplay, preferably full size, such as a Rear Projection display) andtouch (or otherwise indicate on) ones self where action is needed, whichis sensed and via a computer program causes digital model to bemodified. The modifications undertaken are either to the base model ofyou with no clothes, or more specifically the case in this application,the Dressed Model, with clothes on you, as if you are showing a tailoror even a designer what to do. For the future weight/shape aspect, thiscould be showing a weight loss trainer or health professional, for thisaspect of the invention indicating you wish to lose mass in a certainplace.

In the second case, you can look at your digital image in the “mirror”(that is displaying the image of the dressed digital model of you, andreach out and touch the image (as opposed to yourself, in the case “A”above). Your finger position is sensed, which communicates to thecomputer and thence to the dressed digital model what point on the modelto change, and as you move your finger, the degree and direction ofchange can be registered. It is noted that using a new LCD based videomirror “Miravision” product from Philips, the display can actuallychange under electronic control into a real mirror and back again. Thisallows it to be a historic life size mirror, when not used as disclosedherein.

In FIG. 2 your finger or another object or data point, is directlysensed by cameras, while in FIG. 3, the point of touch on the digitalmodel representation is sensed (for example using a touch screen,although the fingers could be sensed alternatively). In the latterinstance, you can look at your digital image in the “mirror” and reachout and touch it, with your finger position sensed, which communicatesto the digital model what point on the model to change. Since the screenis two dimensional, the touching is not quite correct in a 3D sense, butcan be made more realistic through the use of stereoscopic displays with3D glasses and other 3D display technologies if desired.

FIG. 2 a illustrates use of a laser pointer (or other opticaldesignation device), by which a person may designate spots on a personor clothing which are digitized in their position by cameras of theinvention, including as desired other features in the vicinity of theidentified spots. The pointer is held by either the user, or anotherperson aiding the user. Or it can be fixed, with the user moving his orher body to intersect the spot. As has been discussed in co pendingreferenced applications, the laser spot location can be digitized in 3Dif the laser pointer to camera angular relationship is known (easiest ifboth are fixed, see for example U.S. Pat. No. 5,362,970), or if a stereopair of cameras are used, whose relation ship is calibrated or known.For added information on use of single camera or two camera stereotechniques see for example, A paper by Dr. H. F. L. Pinkney entitledTheory and Development of an on line 30 Hz video photogrammetry systemfor real-time 3 dimensional control presented at the Symposium ofCommission V Photogrammetry for Industry, Stockholm, August 1978,together with many of the references referred to therein gives many ofthe underlying equations of solution of photogrammetry particularly witha single camera. Another reference relating to use of two or morecameras, is Development of Stereo Vision for Industrial Inspection, Dr.S. F. El-Hakim, Proceedings of the Instrument Society of America (ISA)Symposium, Calgary Alta, Apr. 3-5, 1989. This paper too has severalreferences to the photogrammetry art).

As shown, person 200 holds laser pointer 201, and aims it at their chestarea 205, the spot 210 on the unwanted crease 211, is detected usingstereo TV camera pair 220 and 221 which in this case are located on thecorners of display screen 225. Both the display and the cameras arecontrolled by computer 230. See U.S. Pat. No. 5,362,970 for informationon how to reliably find the spot location in the camera field.Alternatively you or a friend may aim a laser pointer at a TV screendisplay of the virtual image of you “in the mirror”, and the point ofimpact is sensed on the virtual image and read into the computer.

While triangulation using a single camera and a known laser projectiondirection with respect to the camera optical axis can be used (asdiscussed also in U.S. Pat. No. 5,362,970), this does not allow thegenerally desirable freedom of pointing possible when two cameras suchas herein disclosed are used (whose fixed angular and positional baseline allows determination of spot location no matter from what directionthe spot is generated).

The camera images produce a stereo pair which is matched in the computerand using real-time photogrammetry, the location of spot 210 in x, y & zis determined using known techniques. This spot is then used to identifyto the computer that crease data is of interest, for example in thedressed digital model 235 projected on the screen 225 under control ofcomputer 230 connected to the projection device such as a Sharp BrandLCD based projector (not shown). The fact that the user pointed the spotat the crease on the chest could be announced to the computer by voiceor other means as well. (acts also as a double check on the sensed spotdata).

It is noted that the crease 211 might be on the dressed digital modelrather than on the person, and in this case, the laser spot 210 could bepointed at the model on the display screen, with its indication on thescreen determined as shown in FIG. 2B below relative to the alternatetack of pointing at the feature of interest in the model image on thedisplay screen.

The point 236 on the digital model, corresponding to the inputted dataof desired location on the human, in this case the point hit by laserspot 210, can also optionally be displayed for reference. This isuseful, for example, in modifying the point touched, or in supplyingcorrections to the model.

Alternatively, the laser spot can be used to determine the persons sizeor shape. In this case, the user sequentially can point to a successionof spots, for example in a bicep or midriff area, whose position isdigitized and a sectional shape or 3D volumetric image of the area inquestion built up. This can be used to create a more accurate model,(assuming for example, that one started with a standard model of aperson of a given height and weight) or can be used to update a model,for example created initially with specialized triangulation basedscanning equipment as described in the referenced articles. See alsoFIG. 2 c. Additional cameras such as 222 can be added to improve thestereo photogrammetry solution used to find the spot position or otherdata. Note that the spot can also be used by the user to identify to thecomputer system connected to the TV camera (or cameras)some otherfeature such as an edge of material such as a pants cuff or some portionof the body, whose edge position is desired to be determined by cameraimage analysis using known machine vision software (such as VisionBloksfrom Integral Vision division of Medar Inc) located in the computer. Forexample, if the laser spot projected on ones chest, might be purposelydone so to identify a button resident there to the computer and camerasystem for input to a local or remote data base. This button, onceidentified, would be scanned by the camera system and using such imageprocessing software its data would be inputted to the data base. Forexample, if the laser spot on the arm might be used to identify to thecameras the location of the persons elbow in 3D space.

FIG. 2 b illustrates the use of a woman's fingers to pinch excess clothin the breast area of a garment she sees on a virtual display, with astereo pair of cameras as shown in FIG. 2A to resolve the x, y, and zlocations of the finger tips vis a vis the camera system, and optionallya large screen display, preferably full size (discussed further in FIG.3 next). In a referenced co-pending application Ser. No. 09/138,339, asimilar application for clothes design was noted with the model pinchingor touching the actual cloth on herself, to indicate to a designer (whomight be remotely located) and area which needed attention. In eithercase the data as to the problem is inputted to the computer system, alsooptionally using in many cases voice commands, such as “take it up”,“too tight”, “too loose”, “too bunched up”, “smooth it out”, etc.Alternatively, the same technique for can be used to measurement of faton the body itself, for example at the waist (or elsewhere for inputinto weight reduction programs for example.

In this case at least two sensing modes are possible. First, thepositions of a persons fingers can be directly sensed by the cameras.However this has some problems in the amount of image processing neededto find the tips of the fingers in a reliable manner using affordableimage processing computing which doesn't take too long for user comfort.To aid in this the illustration of FIG. 2 b illustrates a situation(exaggerated in size for clarity) where the user has on his finger andthumb artificial targets (much as one would put a thimble on today),which could be LED's or retro reflectors, or other clearlydistinguishable datum's including contrasting or even retro reflectivenail polish, or patterns on material as another example.

Consider FIG. 2 b where the case of LED targets 245 and 246 (poweredusing batteries or a power supply connected by wires not shown forclarity) are located on the thumb and forefinger 250 and 251 of a user.The LED's are in the simplest case, sequentially illuminated and thestereo camera pair 220 and 221 determine their locations on sequentialTV frames. If one is pulling a fold 255 outward a distance “d” at oneswaist, this distance d can be determined by comparison of the locationsin 3D space of the LED's (or in a 2D view if the user is facing thecameras in an aligned manner). Clearly any location or difference inlocations on the body or clothes on the body can be so measured, andsuch used as inputs to the Body or Dressed model as appropriate. Notethat for clarity only a part of the human user has been shown.

If instead one is pinching the fat 255 of thickness “t” at ones waist,as opposed to a fold of material 255 in the instance just mentioned,this thickness t can be determined by comparison of the locations in 3Dspace of the LED's (or in a 2D view if the user is facing the cameras inan aligned manner). Such fat thickness data is often an input to dietand exercise programs, and clearly any location on the body can be someasured.

In some cases it is desirable to locate the stereo camera pair in otherlocations or to provide added cameras, such as overhead cameras 230 and231 (dotted lines). Generally it is useful for the cameras to be locatedon or near the screen, as is often desirable for mounting and packagingpurposes

Another use of the cameras is to determine pointing direction, so that auser can point at something on is displayed image that he wants tomodify or create or whatever. For example, a line target viewable by thecameras such as retro-reflective line 257 or a pair of targets such as247 and 248 can be used on the forefinger, to allow the pointingdirection of the forefinger to be determined. In this manner, the fingercan point at the displayed image on the screen, and the zone of theimage pointed at, such as point 265, determined, and displayed on themodel by using the computer to feed a point generation command to thedisplay driving electronics. A detected point such as 248 on aforefinger can also be used for other purposes, for example to point atan region of interest, or to trace around an contour of interest, suchas ones thigh to aid the modeling of it, or whatever. The point istracked by the cameras and a sequence of data points assembled in thecomputer to create a contour of the region or a thickness determinationthereof.

FIG. 2 d illustrates use of a laser line or grid pointer to providestructured light sectional data when observed with a stereo pair ofcameras whose dimensions are known such that the line sectional data canbe digitized. The movement of a spot around a surface to sequentiallydigitize the surface coordinates is time consuming, and runs the riskthat the person moves between points. It is generally better for thispurpose to use a line type source such as laser line pointer 270(comprised typically of a diode laser whose beam is expanded in one axisby a cylinder lens) producing where a whole line 271 of points on, inthis case ones arm bicep 211 shown in close up. The stereo camera pair230 and 231 with suitable image processing to extract the line image andphotogrammetry to compute location of all the points on the line (inalmost all cases of angular orientation of the line to the cameras, andif three or more cameras are used, in virtually all cases), giving thebicep contour directly. In some cases added lines such as 272 as well as271 can be projected to give even more contour information directly, andquickly such that human movement is not a problem. A mesh grid ofprojected crossed lines can also be used where desired.

FIG. 2 e illustrates, for use with a single camera, a special, butsimple, probe provided with multiple point targets. As shown a singlecamera 280 (connected to a computer not shown, such as a Pentium III 600MHZ by Dell Computer Co.) is used alternatively to the stereo pair ofcameras shown above. As such, as single point location can in generalonly be determined in x and y, and cannot be determined in 3D space(including z), except using triangulation as noted above where thecamera and laser pointer directions are known relative to each other.

However, a special probe such as 285 can be constructed which has 3 ormore spaced points 286-288 on it which can be identified by the camera280, and the attitude and location of the probe determined. Even morespecifically, where the location of the tip 290 of the probe withrespect to the determined targets is known a priori, the tip location290 can be determined in space in this manner. Thus if the tip 290 isplaced by the user 291 on a portion of his body such as the stomach 294,the location of the point touched 295 in 3D space with respect to thecamera 280 can be determined. And thus successive positioning of theprobe tip on different portions of the body can indicate theirrespective locations to the computer, and the point location 296 on thedisplayed model 235 can be represented.

While TV cameras have been used to illustrate the invention, it is notedthat other sensors such as ultrasonic transducers or inductive devicescan be used (albeit less desirably in most instances) to input data fromthe location say of a persons finger touching either the material or thescreen. An example of such a device is the FreeD ultrasonic unitmarketed for gaming applications by Pegasus Technology, (Holon, Israel)which utilizes 3 microphones to triangulate on an Acoustic source on thepersons finger. In FIG. 2A, if these were used, cameras 220-222 would bemicrophones, and the LED of item 246, for example, would be an acousticsource.

In my experience, ultrasonic devices work in the invention, but they arenot in general as accurate as the optical ones, nor as versatile or dataintensive, nor as potentially inexpensive.

As pointed out in co-pending applications by the inventor, opticalsensors with PSD detectors to detect LED or other Artificial targetimages can be used instead of TV cameras. These generally provide fasterdata inputs, but are single purpose typically, and cannot be used easilyfor the many other applications that TV cameras can, including thefinding of edge features of the clothing, or the detection of clothingpatterns or colors (where Color TV cameras are used). Such detection ofcolor or features is a useful added feature if input to the computer ofexisting clothing having such features is desired.

The invention may be used to input detail on an existing piece ofclothing owned by a person, in order to aid in determining the costs toalter it to a new shape of the same person, or to make it fit adifferent person, such as handing down a wedding dress to ones daughter.As another example, data from an item purchased, lets say by mail order,which doesn't fit, can be inputted to a remote computer to develop aplan for the alterations needed, where for example, the manufacturer orvendor could then authorize a course of action, such as locally fixingthe item, sending it back or whatever. Such data could alternatively orin addition comprise a picture or even video clip of the person in theoutfit, say for example taken from various angles and further includingas applicable, voice data as well.

It is noted that using sensed data from the person, the model shown onthe display screen can also be generated by computer 230 or anothercomputer to have an orientation on the screen similar to that of theperson standing before it. Not only can the orientation be similar, butalso in the extreme, the positions of hands, feet, head and the like besimilar, approximating the actual appearance in a mirror of a person—whomay even move around and change the appearance as a result (in this casewith the model changed to suit).

FIG. 3

FIG. 3 further illustrates data input and display using the invention,also illustrating logistical and commercial aspects of the invention. Adisplay in ones home or elsewhere is preferably, but not necessarily, ona life size screen, and the digital image produced may be created ormodified using an ability to touch ones self or ones digital self (andfuture self) represented on the screen. An interactive session of a useremploying the inventions method of inputting and providing dynamicallyvariable choices of alterations or styles, or even entire lines ofgarments is disclosed.

It is noted that a touch screen can also be used as input, and noveltypes thereof are disclosed in references above incorporated byreference. For this application, the display is preferably located inones home and is preferably a life size display, today created by a rearprojection system. The digital image produced is not only created butthen modified using an ability to touch ones self or ones digital self(and future self) represented on the screen.

With the advent of affordable large screen displays, the digital modelcreated can thus be displayed “life size” even in a persons home, justlike looking in a mirror in a clothing store, but instead seeing a“digital You”, in a particular outfit, and possibly with means to modifyyour appearance (as disclosed in reference 8). Because it is all asimulation, one can “try out” not only different clothes in a lifelikeway, but also see the effects on your appearance in one article oranother, in one size or another, of different courses of action, ofdifferent alteration strategies, and different cost strategies regardingalteration versus custom tailoring and the like. (see FIGS. 4-7 below).

For example consider FIG. 3, which illustrates a touch screen basedembodiment of the invention in this aspect. User 300 looks at the rearprojection screen 305 which has been converted to a touch screen usingthe invention of some of the references above. More particularly, thescreen is illuminated by a micro-display projector 310 (such as a DLPbased projector by In-Focus company), capable of providing a brightdigital and life-size image on the screen, of the digital model 315 ofthe user (or anything else for that matter). This is a dramatic way ofgetting the point across as to what one would look like in differentscenarios, as it is like looking in a looking glass, so to speak. Theprojector 310 and the touch screen readout (of whatever type used), 320are controlled by computer 325.

Indeed, one can touch the digital model 315 of ones self (or if desiredof someone else), just as if you were a “tailor”, and you were workingon tailoring your own clothes. This allows you to tuck, snip, cut,pinch, and other wise modify either the clothes on the model (feedingthe data back into the clothes model data base for example) or the humanmodel underneath the clothes for example, with a “what if” situation,that if one lost just a little weight, or more specifically, if onesarms were just a little less fat.

The data can be taken ideally with either a touch response screen forexample that of reference 2, or TV cameras watching the humans hands orobjects in the hands, or both—just like a tailor uses to touch andgesture (and as shown in other references above). But it can also beinputted by voice command and known voice recognition devices andprograms like IBM “ViaVoice” (e.g. with a command “take in the waist”,or “make arms less fat”), or it can even be typed in on a keyboard orother data entry device.

The modification of the digital model including its pose, shape, etc canbe in any suitable way programmed in to the computer, and can be forcompletely different purposes. In addition the digital model, wheredesired, can be a model of someone or something other than the user. Onecan indeed, just like a tailor, work on someone else's clothes, or likea masseuse, on someone else's body (digital, that is). There arenumerous games that can surround some of these aspects of the invention,some of which were disclosed in the co-pending applications.

The user in this example, on seeing the digital model of themselves in aparticular pants suit, notices the collar is too tight. She then signalsthe computer, in this case by touching with finger 330 the “virtual”material 335 in the neck area displayed on the touch screen 305 in amanner to suggest an alteration, weight loss regimen, or otheralternative that would allow her achieve a better fit. She can tell thecomputer via a voice recognition based command, what she wantsdone—e.g., “take it up”. In return, the computer program itself couldredisplay another suggestion to consider, to the chosen garment. In thismanner artificial intelligence can be added, and not only can thesuggestion be made, the 3D model can be reconstructed to illustrate thechange desired or suggested. Clearly the waist, buttocks or any otherregion could be similarly displayed and dealt with.

On command, the computer program then alters the Dressed modelaccordingly, displaying, for example, in box 340 on the screen, alisting provided from computer 325 of the suggested alterations andtheir costs and allows the user to make a value judgment as to how toproceed. The data can in addition or alternatively be outputted as voicedata from the computer via speakers 370, which can at other times beused for example, to provide restful music other information. If noalteration makes sense, the computer program may alternatively suggestthe closest workable outfit that seems to be of the same type thecustomer desires. Similarly, in the case of body modification due toexercise or weight loss, for example, the computer program can alter themodel shape accordingly. In this example, in box 340 on the screen alisting could be provided from computer 325 connected to internetderived data source 326 for example, of the diet and/or exercise plan ittakes to get there, and allows the user to make a value judgment as tohow to proceed. As before, the data can in addition or alternatively beoutputted as voice data from the computer via speakers 370, which can atother times be used for example, to provide restful music, workout videoinformation, or other useful information

In one case the user may say, that they cant achieve the bodily resultsneeded to fit the particular outfit depicted in time, and that she wouldlike to try on another outfit, or another size of the same outfit. Orshe may say that she is willing to do buy that outfit depicted, if theneeded alterations don't cost too much, or take too much time, in whichcase the computer is optionally asked to compute the cost for same,perhaps by a voice command from the user using microphone 360, or byentering the data via a keyboard or other conventional means.

If all looks ok, the user could be induced to place an order, fordelivery, of the garment desired.

It should be noted that the image displayed in FIG. 2 or 3 above may beof someone else, whom you are helping, with the touch being provided bysomeone who is not the person whose digital model is being presented.This helper can even be remote from the user. It is noted too, thattouch screen 305 may optionally be equipped with TV cameras, such as thestereo cameras 391 and 392 located at the corners of the screen asshown, and as disclosed above, for inputting data from the user or otherpurposes. In addition, a microphone such as 360 is very useful forobtaining voice inputs to help define the action in changing the model,for example by using a voice recognition program such as IBM Via voiceto recognize say the historic clothes alteration commands, such as; Takein; Take out; Take up; Let down; Let out.

In the case of weight loss planning, other ideas can be tried as well.In another session the same or another user may indicate that they wantto really slim down for summer, and begin trying on virtual bathingsuits, so to speak. A series of modifications to the shape are suggestedas desirable by the user, in this example by touching the screen in theareas to be trimmed or expanded on their digital virtual body model, andin each case a suitable diet and exercise plan is presented to help theactual body arrive there. When a plan is reached which the user thinkscan work, in the allotted time, the computer program resident incomputer 325, or remote source 326, then may suggest, if desired, anumber of swim suits of this size or which can be easily altered ormanufactured to suit. Clearly at this point, the user could be inducedto place an order, for delivery in the future, of the garment desired.

However, should the diet/exercise regimen not be followed successfully,or otherwise not achievable, data can be sent to the clothing maker intime, to schedule another size for example. (assuming this option waschosen). Such data can be automatically transmitted, by having an updatesession every week say using the data input devices of the invention oreven manual input to the clothing company's data bank. Similar to thepoint illustrated above, in the case in FIG. 2 e, a probe tip canalternatively be placed on a display screen such as 225, on top of aprojected image location known with respect to the camera, such that apoint 296 on the displayed image 235 can be identified as well.

It is noted that 2D models can be used rather than 3D models, but arenot as lifelike, and much less valuable for depicting difficulties withfit. A 3D model can be rotated and looked at from various angles to seeproblems as they occur, as well as to get a better feel stylisticallyfor a fashion item in question. That said, the invention hereincomprehends that approximating ones appearance from a series of 2Dcamera images, which can be interacted with by simple 2D means, such asa touch screen. Camera images of the person in two dimensions can bedigitally altered to reflect predicted future measurements of the person(after some diet or exercise program, generally) visible in the view inquestion such as front rear or side. As noted above, the person can lookat the starting representation, and determines if desired, any placesthat they would like modify their dimensions, such as by losing weight,and indicates that to the system, which can be done by touching thetouch screen in the areas in question. Or conversely, the system canprovide to the user a sequence of examples showing for example the sameview, in the same type of clothes (e.g. a standard blue dress), afterdifferent diet and weight regimens over different periods of time. Theperson can then select, often with the help of a weight watchers personor other professional (either on the scene, or remote), a desiredregimen. Once selected, views in other clothes as described above can beshown if desired as well, to build reinforcement for undertaking theplan.

In another example, the client/user may indicate that they want toreally slim down for summer, and begin trying on virtual bathing suits,so to speak, using the invention. A series of modifications to the shapeare suggested by a computer program through a loudspeaker or on adisplay, as desirable by the user, in this example by the user touchingthe screen with his finger just as finger 330 is used to touch the modelon the screen above in the areas to be trimmed or expanded on theirdigital virtual body model. In each case, a suitable diet and exerciseplan may be presented to help the computer data base body arrive at theintended shape, typically in a particular virtual bathing suit selected(constituting the dressed body model).

When a plan is reached which the user believes will work, in theallotted time, the computer program then may suggest a number of swimsuits of this size or which can be easily altered to fit or manufacturedto suit. Clearly at this point, the user could be induced to place anorder, for delivery in the future, of the garment desired as has beennoted previously.

However, should the diet/exercise regimen not be followed successfully,or otherwise not achievable, data can be sent to the clothing maker intime, to schedule another size for example. (assuming this option waschosen, and assuming an order had been placed). Such data can even beautomatically transmitted, by having an update session every week sayusing the data input devices of the invention.

FIG. 4

FIG. 4 illustrates an interactive session of a user employing theinvention. For example, user 400 in front of computer display 405, hasmade a choice which causes the dressed digital model 415 to look acertain way. The model is compared to criteria in clothing data base410, and a result obtained which is used to determine the fit of theclothes on the model. A second model such as 416 can also be displayedon the screen, as is discussed below.

For example, if the pants whose dimensions are contained in the database are a length which is within a band 2-3 inches above the ground,when fitted to the digital customer body model to form the dresseddigital model 415, with the waist at the waist of the model, plus orminus ½ inch say, the trouser length could be considered to fit, and anoutput signal, such as a computer generated voice on loudspeaker 406could be programmed to say “nice pants length”, or some such. Aknowledgeable fashion expert would be the person entering the criteriafor determination, based on their experience in the trade. Expert systemprograms, if desired such as LISP or Prolog could be used to aid thisactivity. If the pants length was outside the limits, another pants sizecould be suggested, or an alteration suggested if feasible and its pricegiven if desired.

The same would be undertaken for all dimensions of criticality withrespect to the 3D model of the user, and the results reported. Inaddition, an over all result can be computed, based on all of theindividual results, for example if all within tolerance, it might beprogrammed to say, what is often said in stores: “Looks good on you”!.

If only one dimension, lets say at the hips, were out of tolerance, theprogram could call up from computer memory the words, “Looks good, buttight in the hips”, (or loose, if oversize there) and suggest analteration or some other action to solve the problem. If an alterationwasn't practicable, this could be stated, and the customer encouraged topick a new size, or to choose a semi-custom fit where this portion wouldbe cut especially for them (or pieced together from a version of alarger size). The tolerances could be on an individual measurement basisor on an over all basis—i.e. compare the clothes dimensions to thecustomer body model, and if any dimension is too close to the other, ortoo far, some problem is assumed, for example. However, purposely baggystyles would not for example, easily fit such a strict criteria.

The large screen makes it more realistic, and speakers provide soundstransmitted from the program source which encourage activity—evencomputer generated sounds like “Really looks good on you”, or humanassisted sounds (with an on-line personal fashion consultant), orsomething taken as a direct input from the camera system which couldidentify that the users choices and actions were desirable.

The invention contemplates optional display of the digital model of morethan one person side by side e.g. 415 and 416, for example:

You and a friend.

You and a plurality of friends, the others remotely located with datafiles transferred over the internet or otherwise.

You and yourself from a stored image done last year (to show change inyour model and your clothes size fits. Many people compare themselvesthis way routinely). This could include a dressed model from last year,say in the same outfit for comparison purposes, or it could include yourbody model of last year in the same out fit as this year. And these arejust a couple examples.

You, but side by side in two different outfits, or 3, or 4, and soforth. This is a lot faster than trying on 4 outfits in a row, andtrying to remember which looked better on you.

As pointed out above, it can be 4 versions of you, with the same pantsbut of different waist size (again as noted above aiding thevisualization of different alternatives).

And so on.

A possible advantage of the invention is that customers may be much morelikely to place orders for clothes in the future, somewhat like thelayaway plans of yore but vastly more effective for both manufacturerand consumer. You see what you like, but can be in next seasons designsand your order ahead of time is of tremendous advantage for themanufacturer who can tailor his production accordingly, knowing he hasfirm orders in hand (likely with some modest cancellation or changefee—which itself could depend on the garment price offered). Such ordersfor delivery in the future can also be projected as a result of thediet/exercise aspect of the invention as well.

The future orders placed, can, if desired, be further updated with size,(and if desired or allowed, color or pattern) data from the customerusing the direct computer input of the invention. Such up dates could beeconomically made, from the comfort of one's home, right up until thepoint of manufacture at little or no added cost. Worries then about onessize in the future, and the apriori knowledge of garments design in theFuture are, with the invention, not limits to purchase, a major benefitfor both manufacturers and consumers too, in terms of getting the lateststyles at the earliest time. This fact alone could change the whole wayin which clothes are marketed to some degree.

It is also noted that once a agreed on body model is established bycustomer and vendor, buy-off on clothes purchases by the customer is onthe dressed digital model, and changes made to any initial design areknown. The responsibility for the garment then can be largelytransferred to the customer, other than workmanship and the like—asignificant advantage.

The customer can make inputs to his body model, and the vendor (if themodel is resident there, as is probable) can modify the customer modelwhose effect can be verified by the customer. And the customer using theinvention can make a scan of himself or a zone on himself, and see if asize change on the model corresponds to what he would believe. And hecan physically be displayed the new dimension (e.g. a waist size, orsleeve length, which he can then verify for him self with a tapemeasure, for example.

We can also consider FIG. 4 to be illustrative of an interactive sessionof a user of the invention relating to motivation for a given diet orexercise regimen, and employing automatic computer inputs of theinvention, also providing dynamically changing data during exercise,which further allows one to see the effects on ones appearance ofcontinuing a given regimen, or changing plans.

As pointed out previously, the system of the invention can provideeither locally via storage media, or remotely via internet downloads,what is commonly known as a “Workout Video” to the user, but in thiscase tailored to the users dietary or exercise needs, and capable ofreceiving voice, position and movement inputs from the user, evendynamically where automatic sensing is employed, such as in FIG. 2.

This dynamic nature allows the workout video to be individuallytailored, and even moment to moment paced for the user—just as if aninstructor was present, who might say “you're not moving your armsenough”, “go faster” go higher″, etc. If it goes too fast for comfort,the user can ask that the video slow down, and the video source respondaccordingly so the users don't get discouraged. Rate, extent speed ofthe video and music with it, choice of music with it and many otherfactors can all be called up on demand, and in response—automatically—tothe users own actions.

A large screen display makes it more realistic, and speakers providesounds which encourage activity—even computer generated sounds ofencouragement like “way to go”, or something taken as a direct inputfrom the camera system which could identify that the users movementswere good.

For example, consider in FIG. 4 a different scenario, in which a person400 is doing a workout in front of display screen 405. Input videodigital images, such as man and woman exercise instructors 415 and 416are provided on screen 405 together with appropriate sound on speakers406 from a remote source 410 connected by computer 420 via the internet.(assuming a high enough speed data transfer link, to allow a remotesource to be changed subject to inputs generated locally). For exampleas user 400 lifts his arms in the air, his hands are sensed in theirpeak positions 425 and 426 by TV camera 430 connected to computer 420.The positions in this case are just registered in X and Y, in the objectplane of the camera, with no attempt to determine range, z, from thecamera to the persons hands (possible with the “3D” stereo cameraarrangements of FIG. 2 and other figures).

The X and y values determined and the rate of change therein if desired,are reported from the computer 420 to the remote program source 410(which could be resident alternatively in computer 420), which then cancompare them to norms for that section of the work out video beingpresented—perhaps as well considering pre-entered data into the computerand thence to the program, of the person, such a age, weight, stature,starting condition, and medical issues if needed or monitored such asheart rate.

The program can then dynamically be changed, to go faster or slower,change programming entirely or whatever as a result of the input dataand the dynamically changing data of the person, in this case his handposition and/or rate of change of position. And as mentioned, data canbe fed back to the person as to how he is doing, both by voicegeneration in the computer, or by visual display on the screen, or both.

In addition, a score can be generated, just as if it was a video game.For example, a computed score for having the most motion, the most rapidmoves, the most acceleration during the workout, etc. and this score canbe compared to previous scores of the user, or to scores of othersnearby or around the world using the same program for example. Such ascore “76” is shown generated by computer 420 and provided on the upperright hand corner, in this case, of the display 405. Scoring can bebased on an integral of moves, a mean, or any other tally desired. Somescores directly relate to energy expenditure and weight loss, whileothers could be just for “fun” so to speak.

The invention thus includes a method of providing dynamically changingdata during exercise which allows one to see the effects on onesappearance of continuing a given regimen, or changing plans. It shouldbe noted that datum's can be provided on exercise machines to enabletheir positions and movements to be also entered into the computer, tocalculate activity of a person using them.

The ability to see depicted life-size or otherwise ones own model underdifferent scenarios that would effect change on the model, allows one todo interesting tricks besides. For example one model could be on ascreen in front of someone working on a treadmill. As the personexercises more, his own digital model could changes to indicate theimprovement he will have if he does it every day at the same rate orincline, for example. The treadmill is also a good example, where awalking video can be portrayed to the user, and his movements monitoredwith the invention as well as his pace, as he navigates a path shown ofthe video. The same holds true for riding stationary bicycles, and otherforms of exercise machines. Indeed it is anticipated that people willrecord their own videos, such as a home made workout video perhapsinputted as shown from home camcorder 445 to computer 420 which can thenbe used as sources for others around the world who might like toparticipate with them. Even more applicable perhaps is a biking videotaken by one user going around his neighborhood say, which acts as asocial event with others who can also partake on their stationarybicycles with him, by sharing the video signal over the internet

It is noted that a useful place to set up the invention is in a gym. Forexample, another interesting application of the invention is to performsome of the above procedures while actually exercising, both to killtime, and to provide motivation for improvement. For example it iscustomary for many to watch TV while exercising on a treadmill for 20,30 minutes or so. This time can be spent using the invention, which canpresent the images for example on a screen in front of the treadmillwhich can even be touched by the user if desired, while walking. One canalso sense the user with cameras, similar to what has been disclosedelsewhere.

As another example of what can be accomplished, an illustration is madeof a weight lifter using the invention, in the home or gym. Guessingwhat's important, for those who lift weights, the big attraction may bethe digital model of their biceps, which respond to camera views oftheir weight lifting.

For example, in another use of the same system of FIG. 4, a weightlifter in front of display 400 could lift a barbell, with camera 430viewing his actions. The computer 420 provides via loudspeakers 406inspirational sound and image for the weight lifter, and, as he liftsthe weights (not shown for clarity), the TV camera and image processingprogram resident in computer 420 can be used to identify the amount ofweight lifted (by the number of weights on the barbell for example), andthe height that it is lifted, and how often it is lifted. This data canbe used to calculate the work performed, and other relevant trainingfactors. And such data, plus a pre-entered knowledge of the person, canbe used to predict the eventual outcome of the activity, or to predictthe eventual size of various muscles etc. These muscles can be simulatedon a digital model of the weight lifter as described above. If theactivity is unsafe (too much weight, tilted bar, etc) the computer canadvise accordingly as well. Too much weight after too long a time ofexercise would be one such example.

Clearly, the TV camera can be used for digitization of the activity of alarge number of exercise activities for the benefit of the user. Thedisplay does not have to be a digital model and the modificationthereof, but could be any other kind of motivational presentation forexample. The camera computer combination can be used for otherbeneficial activity as well, such as assuring that movements are notbeyond preset or calculated limits or time integrals related toendurance and the like.

From a cost point of view, it is clear that the same computer display,camera systems can be used for a variety of applications, thus makingeach by itself relatively in expensive. Indeed the Screen (the mostexpensive item, typically) can be used for normal TV show watching orinternet activity as well, or for control of the home—if a touch screen.

FIG. 5

FIG. 5 illustrates several methods which address weight relateddimensional input issues to the digital figure model (also discussed inco-pending references incorporated by reference), and as well illustratehow the invention may be utilized to provide data as to ones futureappearance.

FIG. 5 is a Block Diagram similar to that of FIG. 1 of how the basicinvention is utilized to provide data, in this case as to ones futureappearance. This can be used solely for the purpose of prediction ofones future look with no clothes on, or in a given set of clothesalready on hand, or in an interactive “what if” tradeoff analysis, witha selection of clothes and diet plans for example.

In general for this purpose, the body is measured, not just for itsdimensions that relate to fit of clothes per se, but also with respectto certain dimensions and other medical factors that allow prediction ofthe effects of exercise and diet (to achieve weight loss or gain) on theability to change ones shape. These can include measurement of fat atthe waist, arm girth, and the like, as well as medical tests whose datafrom laboratories or elsewhere can be entered if need be. Height,weight, age, general stature, and other factors—including any specialcase issues, are also generally desired as input.

The invention contemplates that the actual procedure can vary. A typicalembodiment would do the following when used for prediction of futureshape, without clothes; In first step 510, the user enters theirdimensions and other information as called for by the program, which mayinclude, for example:

Dimensions of key parameters of the persons body necessary forestablishment of a minimum 3D model. For example, some are mentionedabove per the Rose patent.

Physical body health related dimensions and other applicable parameterssuch as % fat mass, stature, etc.

Other physical health related data, including Medical history asapplicable.

This data is then provided to the program, which generally is locateddistant and accessed over the internet, but could alternatively be onDVD disc, CD Rom or other local storage medium, or downloaded theretooff the internet for example. A model 515 is then created of the persontoday. The model can be a 3D digital model created by known means, forexample using a 3D solid model package such as “CADKEY”. Such a model isshown in the Textile Technology article referenced above. iscontemplated that the entry of data can in some cases be automatic usingfor example, features of the invention, or the inventions disclosed inthe co-pending references

The program in the second step, 520, then asks one or more questionsrelated to the effects and goals desired, e.g. Lose 10 pounds, or fitsize 12 dress (in the latter case, it would be desirable to enter onespresent size). Or lose a couple inches in the buttocks region, orwhatever. Numerous other variables are entered 521, as need be, whichvariables can be traded off, such as; Calories per day; Type of food perday or week; Type of exercise; Type of exercise machine, if any; Drugs,if any.

To aid the conceptualizing of this, a display of the “Before” model 515,and an “after” model 525, of the person is created from themeasurements, and a video image of the users head 530 superposed ifdesired, as in simply done in the U.S. Pat. No. 4,261,012 patent(Maloomian), or with more views taken as is desirable and taught byRose. More precisely a scan of the persons head may be taken with a 3Dscanning system which may also be used to capture a large number of thepersons body dimensions. It should be noted the face and head scan maynot need to be performed as much as the ones taken to updates the modelin more rapidly changing regions of the body with diet or exercise, suchas the waist. The model at this point more or less looks like theperson, and the effects of the various activities can be seen usingprograms created to model the effect thereof.

The program then can compute or suggest, using a data base, a dietaryand/or exercise plan 535 to achieve the desired results in say twentyweeks. If that is too long, an alternate plan 540 can be requested andcalled up from a data bank and/or computed, and a new model 545 createdto match. Or suggestions 550 made to the user as to what new lessaggressive measurements to back off on achieving might be. Such dataoutput to the user could also contain health tips including vitamins totake, and the like.

By such an iterative process, the user finally arrives at a plan he orshe can live with, and the regimen can commence. If it turns out thatits too tough to achieve, a new regimen for example having 100 morecalories per day, or 20 minutes less treadmill time, can be requested tobe computed and an alternative model and data picture of the resultspresented to the user.

The above points all relate to creation and display of the 3D user modelin various scenarios of diet and exercise and the like. But generally,the user is interested not in what he or she looks like with no clothes,but rather in the clothes normally worn—including clothes for specialoccasions that one often especially strives to look good in.

In this case the invention then further contemplates the extension ofthe digital future basic body model above, to a model 555 with the knowndimensions or other characteristics of clothes added, after selection560 by the user from styles and sizes presented to the user. Such datawould typically be provided by the clothes vendor, for example on theirweb site. The vendor input data is indicated at 563.

The user can now iteratively repeat in step 565 the relevant stepsabove, also with the input of different clothes styles and sizes,together with continual iteration of diet and exercise plan, until thedesired practical health and appearance plan 570 and clothes purchase(possibly for future delivery) 575 is arrived at. As pointed out theinvention contemplates method and apparatus to do all of this inprivate, there is no embarrassment, and the actual true and maintainableplan can be achieved.

The clothes selection step could involve an automated, or even a realhuman on line fashion consultant as contemplated by the Rose work. Orthe online consultation could be from a personal trainer or weight lossexpert. (e.g. a Weight Watchers certified person)

FIG. 6

FIG. 6 is a diagram of a possible “weight watchers” (or other weightloss organization) meeting area 600 constructed according to theinvention which may contain a relatively inexpensive automatic orsemi-automatic dimension scanner 610 (for example operating on opticaltriangulation principles as discussed in the references) to obtain datafrom a persons body 615 in order to calculate using computer 620 thepersons measurements and create a digital model 625 (with or withoutclothes) of the client person which is displayed on a preferablysubstantially life-size digital mirror display 630 (previouslydescribed, and provided by a projection TV) and viewed by the clientperson 640 at a later time for use with the invention.

This arrangement has multiple advantages for all persons involved—theclient, the weight watchers franchise operator and the manufacturer.First, it provides a high level of inspiration for the client, on thefirst visit and on all successive visits. This in turn allows, theoperator to attract and retain clients that otherwise might drop out.And the motivation is also economic, since we believe it further allowsboth the client and a clothing manufacturer to save money. Since themanufacturer can get an early reading of the clients wishes through theinteractive process at the weight watchers site, he can eliminatemiddlemen and inventory, and his production of garments in say 6 monthscan be much more efficient, when he can make a garment ordered fordelivery to the weight watchers site, or to the persons home. Themanufacturer can give a substantial discount to the client as a result,and perhaps help the weight watchers franchisee to underwrite equipmentcost. This then also encourages participation in the program and evenallows the operator to provide incentives as well, since it opens upanother avenue for providing goods and services to the client. It ishypothesized that clothes data would be provided by manufacturers toweight watcher's clients ′gratis″, and that they might even pay thefranchise holder for the privilege.

It is likely best to wait until the last possible moment to make thegarment, as the data coming in from the client (who has preordered anddesirably placed a deposit) is likely changing. If the client has failed(or is failing, as predicted from data taken at a given point in time inthe weight loss/exercise program) to achieve his or her goals forachieving a new shape, and wishes to cancel, a pre-agreed cancellationcharge can be charged up to just before the date of manufacture (atwhich time the manufacturer has purchased the yard goods material, buthas not added value thereto.)

If the hardware can be inexpensive enough, as we feel it can be, then itis likely either the operator or the manufacturer or both would providethe equipment to take the measurements, associate dietary and exercisedata (such as the weight watcher point system they use, possibly inconjunction with other data or input from a fitness club). It is likelya fitness club could be associated with the effort, as could medicalpersonnel if needed—particularly if drugs of some form were involved inthe plan.

While discussed here in the context of location at a weight watcherlocation, it could be at a health club or at a retail store. And in thefuture, as price comes down, all steps can be in ones home, benefitingfrom the internet or other remote data transmission and analysis. Intime, the complete program for everything could be resident on ones owncomputer, and perhaps all clothing data too (after receipt from themanufacturer).

Returning now to the meeting area 600, on the first visit to thefacility, the client s present dimensions measured, their digital modelcreated (and clothes to fit their present model displayed on the presentmodel, if desired). Then a first regimen suggested for the client can beinputted and the results displayed on the future body model, probablydressed in some choice of clothes, which then can be fitted digitallyfrom the manufacturers data base and downloaded to the operatorslocation. This initial viewing and fitting could take as long aspracticable, to give the new client the view of themselves as they wantto see themselves in the future, and to sufficiently inspire them toattain whatever dietary and exercise goal they set.

After “N” visits (N being 1 or several, typically, the choice being madeby client and organization), the client is again re-measured and the newdata is used to predict the future shape of the client, say at the samedesired future point in time (or if desired, an alternate future point,say two weeks later after more benefit of diet). If the results are lessappealing, the client may decide to work with the weight watchersoperator on a new regimen to make up for lost time so to speak, or tosimply digitally try on clothes that are effectively a larger size. Theclient can, in one business scenario, change any purchase requestpreviously given the manufacturer at this time (as for example to size,but also color and so forth), or cancel.

To aid the user in visualizing themselves, one can provide a threedisplay system, that, just like a fitting mirror today in a store, showsthree digital views at once so to speak, having the advantage too thatone can show a complete rear view on one screen, a front view on anotherand a side view on a third—but unlike the store case today, all screenscan be if desired in front of the user, since the display is created inthe computer. Such an arrangement is nice, but expensive, and notactually needed, as one can show any view desired in succession on thescreen—front, back, sides, angled etc. even oblique views from the top,or bottom.

And as pointed out above, one can show “before” and “after” body model,or dressed body model, presentations (predicted as a result of any givencourse of action), either in succession, or side by side. And one canlook at the predicted model, and suggest that from a clothingperspective, you would like more material to be removed say from a givenplace. Or in the case of the users action themselves, if they wanted tolose or gain more body matter in a particular place, course of action toachieve that, where practical, could be provided the user in the form ofa printed document or whatever, and the future body model predictedusing that data, as well as any dressed version thereof using theclothes data base.

While the above discussion has focused on carrying out the dimensioningand feedback at a weight watchers meeting room, this is not the onlyvenue. As noted it could be in a retail clothing store, a sporting goodsstore, a fitness center/health club, or even a car dealer who would usethis feature to build traffic. But as pointed out above, and in ourearlier '797 application (to which this application is a continuation inpart), it can also be in the home, which has a big advantage for thosewho do not want to discuss or demonstrate their body shape with others.The invention comprehends that the special equipment needed for fullutilization of the invention, if desired, could be rented from theweight watchers group, or from a store or whomever. This is particularlypossible since the time of use may be for a specific limited time frame,such as 6 months. (the well known desire after the Christmas holidays toget slim by summer, for example). With this done, the dietary and otheradvice provided can all be done over the internet or by other means. Asthe price of equipment becomes less, and/or usable for other purposes,permanent home installations become possible. A full length digitalmirror provided by a projection or plasma TV, can, when turned sideways,become an HDTV for the family room for example. Some types of sensordevices used in the home to take data as to positions on ones body, canalso be used for games, and so forth.

FIG. 7

When using digital models it is desirable to not just look at one view.With a set of simple 2D views, this means switching from front to side,and likely to the rear as well. Each would be need to be shown in thefuture predicted shape. In FIG. 7A a simple means of creating 3D modelsfrom 2D views is illustrated which is helpful for low cost use of theinvention. As shown a person 700 wishing to use the system is imaged bycameras 710-713 which take an image of the front back and both side ofthe person respectively. The images from these cameras 720-723 aredisplayed on displays such as 730-733 respectively. The displays 730 and733 are of the front and back cameras, while the display 731 and 732 areof the side. Other arrangements are possible, and it is noted that somedisplays can sequentially display different camera images, or even splitscreen images with two camera views one display. For example the modelon display 733 illustrating the digital model of the persons rear view,can be displayed on display 730 in front of the user, or in position 735off to the side

In this example, illustrated in FIG. 7B with respect to two camerasonly, the user 745 facing camera touches themselves (or other wiseindicates for example using a laser pointer) at key points visible totwo cameras, for example camera 720 in front and camera 721 on the leftside as shown Since the cameras are orthogonal to each other, the samepoint touched on themselves in both a front and side view allows thecomputer 750 to create a 3-D coordinate for that point (point x and y inone view, y and z in the second for example).

The user can assist the program by doing this at a number of points, inessence then creating a very simple 3D model from a set of digitalcamera views. The displays aren't even needed in the simplest case, asthe user can touch themselves and the data is recorded. It is possiblethat using still pictures, one can also record ones voice as to whichpoint is touched in which frame. For example a 3D coordinate point 770can be created for the top of the left shoulder 760 of person 745touched by finger 765 of the persons left hand. Or max hip position onleft side as another example.

The cameras can record this dynamically as well, allowing the user totrace oneself in essence with a continuous string of points, building upthe body model as one moves ones finger along it. And one can use twofingers at once if there are sufficient cameras. For example a user canwhile facing the front camera and display, touch the two opposite pointsof their waist, one point with a finger of each respective hand. In thiscase, the front and back cameras can see both fingers touching, whilethe side cameras just see the one on their side.

In another example, a loudspeaker driven by a computer program used toanalyze the point locations can tell the user where to touch next. Inthis manner a model can be built up taking the minimum number of pointsneeded by the program in question to generate the resultant 3D model (orfor that matter 2D models, if such was wanted).

The invention can be used in the diagnosis and treatment of mental,behavioral and other disorders. In addition, the invention in a relatedmanner also contains novel methods helping the mentally ill and otherpersons improve their quality of life by creating life-sized digitalpersons they can interact with.

Treatment of Anorexia and Bulimia. A previously described, the personusing the invention, once their data is entered, sees them self as acomputer model on a life size screen, preferably in a 3-D graphicalrepresentation. But this isn't them, it's the model. In one form ofoperation, the invention may then display a normal persons model, withmeasurements and provides a comparison of the two models. The amountneeded to increase to meet the desired normal person is shown inanimated movements, such as 1 month, two months etc, until one grows out(note this animated sequential presentation of future models can also bedone to show ones rate of decrease due to a weight loss program). Thistype of presentation may help those with anorexia or bulimia to seetheir digital selves as against other persons (such as idolized persons)digital representations, rather than relying on real life views whichare subject to interpretation. This may have therapeutic value,particularly if the person wishes to become just like their idol, whogenerally is not suffering from the disease.

The invention can be used to provide a digital 3D model of a partner foran ill person or other person on the substantially life size projection(or other) TV screen of the invention. This partner can be programmed tocarry on a conversation with the person (who is often lonely and needssomeone to talk with or dance with, or do something else with), with thedialog done remotely over the internet (for example by physiologists orother medical professionals, or from pre recorded video clips from DVDstorage say, perhaps in response to questions asked and recognized byvoice recognition software such as IBM ViaVoice. Alternatively or inaddition, the dressed body model of the user can also be displayed onthe screen, such that the dialog between ones self and others (whichcould be many) can be observed in the third person. The dressed model onthe screen, which could be of another person, or the user, or both, canfor example dance, in tune with music, and this can be a dancing partnerfor the user. Dance therapy of this sort is often valuable for personswho are ill and often alone.

To effect animated activity of this sort requires more powerfulcomputers than quasi static fashion or weight applications since thewhole model (or significant portions) needs to be changed dynamically,which is computationally intensive where 3D models are concerned. APentium 4 with 3 GHZ together with a high quality ATI or Nvidia graphicscard however can do this job with simple 3D models The patient can forexample, be dancing or talking with a person model depicted on thescreen. The person model could be that of a family member, a friend, adoctor or whomever. This interaction could also be done in the 3^(rd)person, with the dressed body model of the patient also depicted on thescreen, having a conversation or other physical interaction with theperson model. In this case it is generally necessary to sense theposition and orientation of the patient in order to manipulate the imageof the patient on the screen. It might however be therapeutic to havethe image driven by a computer program, which would cause the patient tothen say words in response to what he saw his virtual 3^(rd) person selfdoing. For example, making a social error. This can be part of thetherapy itself, and video and audio recordings of the activity of thepatient in response to the visual images and sounds can be recorded forlater diagnosis.

Some other implications of the invention should be noted. For one, it isentirely natural—that is what the user may do in his home, or over theinternet, resembles what one does today. You see yourself in a “mirror”(depicting your virtual digital 3D image in clothes, and you instructvocally or with your hands and fingers to someone to alter the clothesto fit (or you do it yourself). Or you pick some other clothes. And youtry to do it in the most economical manner, in both clothes cost andtime. The internet or other such enablers of communication and data basemedia, and the vast choice of styles, manufacturers and alterationpossibilities (especially with the invention leading to same) allowsmuch more efficient execution of this task, to arrive at a better fitand more cost effectively. Alternate choices presented for selection canbe either manually accessed, or automatically chosen via a programmedfunction based on the user model, fit, and preference data inputted, andthe deviations from desired results indicated by the user. And you maydo all of this in the comfort, and even more importantly, the privacy ofyour own home.

It is expected that many weight, health, exercise, and clothes consciouspeople will spend considerable time in comfort of their home for hourstrying out different programs, trying on virtual clothes, and engagingin workouts and other entertainment activity interspersed with theirclothes selection activities. The expected weight of a user in a givenregimen or activity, in pounds kilos or whatever, can be displayed onthe screen of the invention along with the digital model portrayed. Thevarious models and regimens can be stored on digital media for furtheruse in the future. It is also noted that the same display can be usedfor entertainment—TV, internet etc, and thus have little added cost. Andusing programmable optical elements (e.g. from Digilens), or using thenew Philips Mirror display one can switch between a normal mirror, and adigital display of a model. This allows one to truly feel like they arelooking in a mirror!

It is not easy to predict the way in which weight is lost from the body.Each user may have a different reaction to a diet and exercise plan, inso far as how each of their body dimensions changes in the predictedfuture model. By analyzing, using a computer, trends in, for example,the change in one or more dimensions (for example waist size) as afunction of the treatment plan and time, generally in conjunction withmedical, and/or other data concerning the person, or similar persons, orother parameters or information, this prediction can be made moreaccurate. Alternatively the analysis can be made remotely, using databanks from other persons, such as those with similar physicalcharacteristics, backgrounds or the like.

With suitable computer processing power it is possible to have dynamicmodel animation thru which one can visualize the way in which ones bodychanges with exercise, diet or other regimen: Such an animation can showthe user how they originally (at the start of a diet program say) wouldhave changed, versus how they actually have changed, and are predictedat the time the animation is viewed to look when they are finished theparticular program regimen in question. By watching the informationdynamically (effectively speeding up time, from a few months or more toa few seconds), the person may get a better feeling of the effect ofchanges in diet or exercise affect their appearance in the future.

What we call “Partial Mass Customization” is a unique aspect renderedpracticable the invention. Today one picks clothes off a rack, tries ontwo or three sizes, and picks the size that fits you assuming you likethe item. Sometimes you have to pick an item you like less, just becausethe thing you want in your size is sold out. Or you have to give up andgo to another store. All this is wasteful in time of both customer andsales people. And extremely inventory dependent, and accordingly costlyas well. In addition, when you find the item, it may not totally fit.The more your figure does not conform to certain norms, the more theclothing may have to be altered, a time consuming task, involvingfurther labor and then a time delay until pickup. Those withexceptionally variant figures, are often forced to take ill fittingclothes (e.g. baggy) just because nothing else can fit within reason.

Because of all these problems, the possibility of mass customization hasbeen studied, as pointed out in the introduction to this patentapplication. In this scenario, each persons exact measurements would beinputted to a program, which would then cut the cloth in accordance withthese measurements, and the garment would then be sewn, or other wisemanufactured, and delivered, possibly within a few days. This is justlike tailor made clothes of 100 years ago, but at affordable cost due totechnology advancements. In some circles it is viewed as “the future”.

There are two problems with this. Delivery is relatively long (thoughnot impossibly so), and what if it doesn't acceptably fit, for whateverreason? Who then fixes it? If unfixable by whatever standard, is itresalable to others? What the invention herein optionally proposes, isan in-between situation. It works like this, in one example:

The customer orders an article of clothing which is preferably displayedto the customer on a digital model of the customer. At this point thecustomer can clearly see, in some ways better actually than in a storemirror, due to the better vantage points allowed, and computer aidspossible, just where the garment doesn't look right, to his or hertastes (virtually like the tailor in the store, saying “hmmm, I think weshould take out the waste a bit, don't you think?”, or some such). Inaddition others in the household, who otherwise wouldn't have been ableto take the time to assist in shopping, can also peruse the digitaldressed model (also stored for later viewing, if more convenient) andgive their opinion.

At this point the customer and friends if applicable, can identify theproblem in the waist (or other area), and signal the computer. Thecomputer program then calculates effecting such a change, and redisplaysthe recalculated digital dressed model image—as if the change hadoccurred. The customer then says no, only half an inch, etc. And soforth, iteratively until the garment looks right. Or the computer canjust display 4 images, each with a waist size a half inch apart(equivalent to trying on 4 sets of pants in the range 36 to 38 incheswaist for example).

Once decided (also as to fabric, color, etc.), an order is placed andthe garment made. But in this case, only the portion modified has to becustomized, and this can be done manually or automatically viaalteration. Or it can lead to a selective assembly and manufacturingprocess where only this portion is changed in its production. Where onlyan alteration process is involved in adapting a given standard dimensiongarment to someone whose dimensions vary in certain areas, conventionalmanufacturing techniques and distribution systems of today can be usedfor the most part. The actual alteration can be done at the factory, ormore locally at high volume (and lower cost) alteration centers, or evenin a “do-it-yourself mode, in your own home.

Take the pants example of FIG. 4. A manufacturer could ship all pants tothe local center with pants un-cuffed, with this work donelocally—(pants of un-cuffed lengths are relatively the norm today andare being used here only for illustration purposes, however theinvention dramatically shortens the time involved in this procedure andreduces its cost). With the customer order of a given length, this partof the manufacturing process of the garment would be completed, and thepants delivered directly to the customer. Clearly this could have comefrom the more distant manufacturers plant directly as well as from alocal center.

In a more exotic example, the pants could be shipped to a local centerprecut to length, but not sewn in the waist area. In this case,according to the customer dimensions inputted to the computer system,the pants might be chosen first for length, and then sewn to fit thewaist, and if desired, the buttocks or thighs of the person ordering theclothes. The design of the garment would have to accommodate thisactivity (leaving extra cloth in certain places, for example).

Clearly all of the above could be done, with the pants also cuffed tolength at this stage as well. There are many combinations of proceduresalso which could be optimized for any given type of apparel. At theextreme end, one could even begin to cut out (say using a programmableGerber cutter for example) certain component pieces of a garmentespecially for the customer using the dimensions of the customer bodymodel or variations suggested by the customer in the Dressed Model.

Taking this to its logical end, if one individually cuts out andassembles a garment using the body model one has a completely customizedgarment such as talked about in the various mass customization articlesin the textile trade, and as exemplified in the references. But only inthis invention to the inventors knowledge, have the other two issues ofsuch extreme customization been addressed, namely;

The use customer suggested changes of the Dressed Body model to act asfurther the input to the manufacturing program plan, and

The use of selective assembly of precut pieces, with alterations asneeded, to in effect approximate a full customization taken from a bodymodel (and further having the advantage 1 above).

Perhaps the most compelling argument for local alteration, is thequestion of returns. The customer in effect, is “buying-off” on thedigital dressed model. This is more risky for the seller/buyer thantoday, where the buyer buys-off on the actual garment, with alterationshe personally commands. But it is less risky than ordering a totallycustom garment.

If the clothes don't fit to satisfaction, a local alteration point canalso act to fix them, after delivery, if complaints result. And if theyare unfixable to that customers satisfaction, they at least can beresold to someone else somehow, as they are a standard size with somechange only. And since they are duty paid, if imported, customs costs ifany are reduced If the alteration aspect of the invention is donelocally, due to local labor content.

The risk to both seller and buyer is lessened if only small, known typesof changes are made in standard garments. Thus the computer programselecting clothes would attempt to steer the purchase to such asituation. This can be done, for example, by pricing large numbers ofchanges and/or complex changes commensurately higher. In practicing theinvention, manufacturers might produce an extra number of some portionsof the garment knowing that certain areas according to the inventionwould be more likely to be modified than other areas. Note in thepartial customization process disclosed herein some alterations might beallowed, others which are too difficult, not. Also the computer of thesystem at the manufacturers or vendors site, can calculate the cost ofalteration or customization so customer can see the price of his wishes.

Alternate choices presented for selection can be either manuallyaccessed, or automatically chosen via a programmed function based on theuse model, fit, and preference data inputted, and the deviations fromdesired results indicated by the user. The expected weight of a user ina given regimen or activity, in pounds kilos or whatever, can bedisplayed on the screen of the invention along with the digital modelportrayed. The various models and regimens can be stored on digitalmedia for further use in the future.

It is noted that the same computer display and camera systems can beused for a variety of applications, thus making each by itselfrelatively in expensive. Indeed the display screen (the most expensiveitem, typically) can be used for normal TV show watching or internetactivity as well, or for control of the home—if a touch screen. In astandup mode the large screen display depicted in FIGS. 2-4 can be usedfor various games such as quick draw, charades, etc. the screen or theimage on the screen can also be rotated to the horizontal by the user tomake a wide screen TV display.

Voice recognition techniques usable with the invention are now beingresearched in earnest in order to allow the user to interact withcomputer based functions. IBM VIA VOICE and DRAGON SOFTWARE NaturallySpeaking products have already reached the general office market, andare reasonably accurate and effective if the surrounding environment isquiet and stable. More reliable in noisier environments are thosespecialized limited capability such as Fonix Corporations AutomaticSpeech Recognition (ASR).

As has been noted above the invention has a value in motivating peopleto hold to a health plan, diet, exercise, or both. And it may encouragesome medication as well. This can be its main or only function,independent of the clothing issue, even though clothes are often thebiggest motivator, as that is how the world sees you, and how you wantthe world to see you.

The video data of ones present or future predicted model, generallyfully dressed, can be shared with others over the internet or otherwise.This provides an added degree of motivation, in that one can exchangeprogress notes with ones friends, as well as with advisors such asweight watcher personnel or fitness trainers, health scientists ordoctors. Such data can also be accompanied by actual digital photographswhere desired. The expected weight or other measurements of a user in agiven regimen or activity, in pounds, kilos or other suitable andunderstandable units, can be displayed on the screen of the inventionalong with the digital model portrayed. The various models and regimenscan be stored on digital media for further use in the future. Theinvention can be used as well to predict the future shape and appearancewith or without clothes of persons who are on medical regimens, forexample drugs with weight or shape changing side effects

The invention may also incorporate data as to your past shape, and usethat in forming a comparative model, or in aiding further definition ofwhat exercise or dietary plan will achieve a certain future shape. Forexample consider the apparatus of FIG. 7, which captures two dimensionalimages of the person, and uses these to generate a two or threedimensional body model. Such images can be obtained from photographs aswell, either digital photos or scanned film photos, which can yielddimensional data and relationship including shape parameters.

If for example, if it was known that a person weighed 20 pounds less atsome point in time in the past when a picture was taken, and/or hadcertain measurements taken from either that picture, or known in someother way (which also could be taken from a particular size of clothesfor example a size 36 waist trouser on the person) then this data can beused to aid in the prediction of a future body model at different timeswhen the person under took diet or exercise. Such a plan is often indeedundertaken so that the person can “fit into” some clothes bought in thepast as a result of undertaking a diet and/or exercise program.

The foregoing discussion should be understood as illustrative and shouldnot be considered to be limiting in any sense. While this invention hasbeen particularly shown and described with references to preferredembodiments thereof, it will be understood by those skilled in the artthat various changes in form and details maybe made therein withoutdeparting from the spirit and scope of the invention.

1. A method for assisting a person undertaking an exercise programcomprising the steps of: providing a computer model of at least aportion of the body of said person; electro-optically monitoring, duringexercise, at least one point on said person's body which is affected bysaid exercise; using said monitored point, determining a change in saidcomputer model; and dynamically providing information concerning saidchange to said person while said person is still exercising.
 2. A methodaccording to claim 1 wherein an image derived from said changed model isdisplayed to said person.
 3. A method according to claim 2, wherein saidimage is a 3D image.
 4. A method according to claim 1, including thefurther step of considering medical data concerning said person inproviding said information.
 5. A method according to claim 1, includingthe further step of monitoring a heart rate of the person whileexercising and providing information relating thereto to said person. 6.A method according to claim 1, including the further step oftransmitting said information from a remote location over the internet.7. A method according to claim 6, wherein said information includesmotivational or instructional messages to said person.
 8. A methodaccording to claim 1, where said information is provided in response tosaid person's actions during said exercise.
 9. A method according toclaim 1, wherein said information includes computer generatedmotivational or instructional messages to said person.
 10. A methodaccording to claim 1, in which said information concerns the safety ofsaid person.
 11. A method according to claim 1, further including thestep of modifying said information provided at a future time as a resultof a change in said monitored exercise by said person.